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Abstract 

The Ami project was a six month Rapid Innovation project sponsored by JISC to explore the Virtual Research 
Environment space. The project brainstormed with chemists and decided to investigate ways to facilitate 
monitoring and collection of experimental data. 

A frequently encountered use-case was identified of how the chemist reaches the end of an experiment, but finds 
an unexpected result. The ability to replay events can significantly help make sense of how things progressed. The 
project therefore concentrated on collecting a variety of dimensions of ancillary data - data that would not 
normally be collected due to practicality constraints. There were three main areas of investigation: 1) Development 
of a monitoring tool using infrared and ultrasonic sensors; 2) Time-lapse motion video capture (for example, 
videoing 5 seconds in every 60); and 3) Activity-driven video monitoring of the fume cupboard environs. 
The Ami client application was developed to control these separate logging functions. The application builds up a 
timeline of the events in the experiment and around the fume cupboard. The videos and data logs can then be 
reviewed after the experiment in order to help the chemist determine the exact timings and conditions used. 
The project experimented with ways in which a Microsoft Kinect could be used in a laboratory setting. 
Investigations suggest that it would not be an ideal device for controlling a mouse, but it shows promise for 
usages such as manipulating virtual molecules. 



Background 

Amanuensis: One employed to take dictation, or copy 
manuscripts; A clerk, secretary or stenographer, or scribe 
http://en.wiktionary.org/wiki/amanuensis 

The chemistry laboratory is a difficult environment for 
using a computer. Space is at a premium; benches and 
fume cupboards are covered with apparatus and typi- 
cally have chemicals that are detrimental to computers 
(Figure 1). The chemist wears protective clothing, and 
often has gloves on (Figure 2). Lots of little issues add 
up to make it a challenge to successfully use computers 
in the lab. 

Yet the collection of data has never been more impor- 
tant. Trends in science are to require data in support of 
experimental results. It is considered that research paid 
for by public money should have the proceeds visible to 
anyone who may wish to use them. Recent examples of 
challenging the conclusions of the scientific community 
- such as MMR episode [1] or the Climate-Gate emails 
[2] - plus various examples of scientific fraud, are all 
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events that could have been ameliorated if their data 
were open for review. 

In recent years, various projects have highlighted how 
hardware and software can be used for the collection, 
management and use of laboratory information. At the 
University of Cambridge Cavendish Laboratory Baum- 
berg et al [3] illustrate how new hardware forms (desk- 
top "Surfaces" and tablets) facilitate the use of visual 
sketching techniques to enhance the scientific process, 
in particular within a group. The Frey group at South- 
ampton have shown [4,5] how semantic tools can be 
used to link complex information from the whole 
experiment lifecycle. The OPSIN chemical name-to- 
structure program [6,7] developed by Lowe et al. here 
in the Unilever Centre has been extended to show how 
complex information can be accessed using smartphones 
[8]. 

The Ami project was created to find improved ways 
for chemists to use computers in the lab. The goal was 
to build a prototype next-generation information assis- 
tant "natural user interface" for scientists working at the 
lab bench. The limitations of paper lab notebooks are 
well recorded, and the Chemistry Department at 
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Figure 1 Chemist working at a typical fume cupboard. It is 

common to use the glass front for drawing reactions, jotting notes, 
etc. 

V ) 



Cambridge has recently deployed a commercial electro- 
nic lab notebook (ELN), a project in which one of the 
Ami team members was a significant participant. The 
Ami project aimed to combine and develop existing 




Figure 2 A chemist happy in his element, and probably with 
his elements too. Note the protective clothing. Space in the lab is 
at a premium; catering for computer is an after-thought. 

V / 



hardware and software technologies in novel ways to 
provide an information rich environment for the scien- 
tist at the bench. 

Methodology 

The Ami project used a brainstorming session with 
chemists from the department plus representatives 
from the Chemistry Department's computing service to 
identify the issues that chemists have to deal with and 
how computers could be used to address them (see 
Appendix 1 for further details). A common use-case 
that emerged was the example of how chemists often 
reach the end of their experiment and find an unex- 
pected result. Often the suspicion is that the unex- 
pected result could be due to mundane reasons; the 
conditions used for the reaction may have varied unex- 
pectedly, or reaction components were not added, or 
timing was critical, or the wrong chemicals were used, 
etc. What was required was some way of going back 
over events to see what actually did happen. What was 
needed was some way of collecting ancillary data - 
data that is not the primary data that is scientifically 
obvious to collect - that could be consulted after the 
experiment is finished if circumstances needed to be 
investigated further. 

The desire to log ancillary data identified three areas 
to work on. The first was to build some hardware device 
that could monitor parameters such as the temperature 
of the reaction vessel, keeping a log over the whole 
duration of the experiment. The second was a video 
monitor to provide a close-up visual record of the reac- 
tion. The third area was a wide-angle video monitor of 
the whole fumehood which would log all activity in the 
vicinity of the reaction. 

Windows 7 was chosen as the development platform 
for Ami. This was because of the wide availability of 
software tools and utilities available for Windows, and 
also because of the experience within the group. Where 
possible code was developed in Java, using the IntelliJ 
IDEA development tool. 

Ami Client Application 

The Ami client application - "Ami" - is the central 
application with which the chemist interacts when in 
the lab. The chemist logs into Ami using their identity 
badge which is detected by a Touch- A-Tag RFID reader. 
A list of experiments is then displayed, plus the option 
to create a new experiment (Figure 3). 

Having selected their desired experiment, Ami then 
displays the main experiment control screen. Tabs at 
the top are used to switch between the Event Log, Sen- 
sor Control, and Experiment Details screens. All tabs 
and buttons can be controlled using speech, the key- 
board, or the mouse. 
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1 4y\ AMI v 1.01 logged in as pin418 



r Recent Files 

Experiment 5 - Oxidising Alcohol 10/01/2011 (15:05:47) 

Experiment 6 - Reducing carboxylic acidslO/01/2011 (15:05:44) 
Experiment 4 - Test of theory lb 10/01/2011 (15:04:31) 

Experiment 3 - Test of theory la 10/01/2011 (15:04:18) 

Experiment 2- Cup of Tea 10/01/2011 (15:03:10) 

10/01/2011 (15:00:17) 



Creating new experiment. . 



Control Panel- 



u 



New Experiment 



Open Selected Experiment 



Browse For Experiernents 



* 



Delete Selected Experiment 



Rename Selected Experiment 



Help me 



Disable Voice 



Log Out 



Figure 3 The Ami experiment selection screen. 



The Event Log shows all the events that have occurred 
in the experiment. The log can be filtered by event type 
if desired (Figure 4). 

Ami allows all chemicals and pieces of apparatus used 
in the experiment to be tagged with an RFID tag. These 
are easily and cheaply available in a variety of forms so 
that they are easy to stick to chemical bottles and appa- 
ratus. During the experiment, the chemist registers all 
the components with Ami. 

As an experiment proceeds, the chemist logs usage of 
chemicals and apparatus by simply waving them in front 
of the RFID reader. The date and time of the event is 
recorded by Ami, so that a timeline of events in built up 
showing activity in the experiment. The chemist can 
also add observations by dictating to the PC's micro- 
phone, or simply by using the keyboard. 

A refinement of the RFID tagging was an "intelligent 
labcoat". This was achieved by using a mini Arduino card 
with an RFID reader built into the sleeve. The Arduino 
had a Bluetooth transmitter with it, which was able to 
transmit readings to the Ami application running on a PC. 
The RFID detector in the labcoat sleeve automatically reg- 
isters any tagged chemical or piece of equipment that the 
chemists hand goes near. The events logged by the labcoat 
are then transmitted to the Ami application for including 
as part of the experiment timeline (Figure 5). 

Each sensor monitored by Ami has its own logfile 
(Figure 6). All output files are stored in one directory 
for each experiment, making it easy to keep track of all 
data created, and to transfer it to the electronic lab 
notebook. The output from all the sensors and events 
can be displayed as a graphical timeline to facilitate 
review of the experiment activities (Figure 7). 



Monitoring Device - Arduino 

For close-up monitoring of the reaction, an infrared 
temperature sensor was used (Figure 8). This was con- 
trolled by an Arduino circuit board (Figure 9), which 
was programmed using the open source Arduino soft- 
ware [9]. 

The Ami Experiment Monitoring Tool also has an 
ultrasonic distance sensor and an infrared PIR motion 
sensor. Output from the sensors is sent to the Ami cli- 
ent application, which is a Java program running on the 
PC. 

Close-up video monitor 

The usual way of doing time-lapse photography is to 
take a still picture at regular intervals, then stitch them 
together to make a moving picture. We wanted to do 
something slightly different; instead of a still picture, we 
wanted to use a few seconds of normal moving video, 
and then stitch them all together to make a time-lapse 
video. The advantage of this is that it is then possible to 
see how a given material is behaving (e.g. viscosity) 
which isn't possible from a still picture. 

Recording time-lapse video turned out to be more dif- 
ficult than expected. We were unable to find an off-the- 
shelf application that we could use to provide this func- 
tionality. Open source Java routines to monitor video 
had performance issues, for example very poor frame- 
rates. The main problem seemed to be that available 
Java-based open source code was out of date; it was all 
based on the Java Media Framework (JMF) [10], the API 
of which has not changed since 1999, and the last 
minor modification was in 2004. The open-source 
FFmpeg [11] utility was also tried, but its video capture 
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Toggle display of events: 



^5 EventL °9 Sensor Control f| Experiment Details 



o 



Show None 



Chemical 





^ Physical 








Sensor 




^ User 



















14:50:26 (10/01/2011) Sensor control 




Stopped logging 


(3) 


14:48:31 (10/01/2011) Sensor control 




Started logging 


(4) 


f 7 *) 14:47:07 (10/01/2011) Comment 


Water appears to be turning a deep br... 




(5) 


^ 14:46:48 (10/01/2011) Tea 


2.5g 


Added over 5.0 minutes 


(6) 


J^J 14:42:42 (10/01/2011) Large Ceramic Mug 




Set up equipment 


(7) 


^ 14:41:03 (10/01/2011) Boiling 


Duration: 4.6 min 


Started 


(8) 


£ 14:40:57(10/01/2011) Water 


350.0cm3 


Added over 5.0 minutes 


(9) 


J^J 14:40:55 (10/01/2011) Large Kettle 




Equipment used 


(10) 


£ 14:39:10 (10/01/2011) Milk 


5.2cm3 


Waiting to be added 


(11) 


£ 14:38:33 (10/01/2011) Sucrose 


12.1mmol 


Waiting to be added 


(12) 


*f 14:38:02 (10/01/2011) pm418 




Created experiment 


(13) 



| Register Chemical 1 


Register Equipment 




[ Register Comment ] 


[ Register Physical Event ] 



Save current log to text file 



View event timeline 



'pm418 dosed experiment' deleted 



Help me Experiment runtime: 



Figure 4 The Ami Event Log screen. The main body shows events logged. Buttons across the top allow selection of different event types. At 
bottom left are buttons to log different events. Buttons at bottom right are for saving data and launching the timeline viewer. Tabs at the top 
switch the display to the Sensor Control and Experiment Details screens. 



Event Log Sensor Control £ Experiment Details j Object Temperature 



Object Temperature - 



Minimum / °C: 



Ambient Temperature - 



Minimum / °C: 



5 Plot 



p|jr) Maximum /°C: 



100 C Logging interval / s: 



o[£j| Maximum /°C: 



100|-7-|| Logging interval / s: 



l|4j| Current value: 2045 °C £ 



Current value: l&Ol °C ^ 



Logging interval / s: 



Current value: 0.0 cm 



□ 



Logging interval / s: 



■Interval Video Capture - 



(T*g; Start webcam 



I Stop webcam 



I Play videos 



rMotion Triggered Video - 



Switch On Switch Off Play videos 



Motion Detected? 



I Start Logging 



I Stop Logging 



Sensor: Sensor control started logging 



Help me I Experiment runtime: 0=10=37 



Figure 5 Sensor control tab. Alarm limits can be set for upper and lower temperatures. Time interval can be specified for taking temperature, 
distance (ultrasonic sensor), and motion detection (infrared motion detector). Buttons at bottom left are used for starting motion-timelapse 
video and environs-monitoring video. Buttons at top right control display of sensor graphs. 
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event- log - Notepad 



File Edit Format View Help 



Event Log: 

Pete created experiment at 14:38:02 (10/01/2011) 

sucrose (12.1mmol) was waiting to be added over 1.0 at 14:38:33 (10/01/2011) 
Milk (5.2cm3) was waiting to be added over 0.01 at 14:39:10 (10/01/2011) 
Equipment used: Large Kettle at 14:40:55 (10/01/2011) 

water (350.0cm3) was added to reaction vessel over 5.0 at 14:40:57 (10/01/2011) 

Boiling was started for 4.6minutes at 14:41:03 (10/01/2011) 

set up equipment: Large ceramic Mug at 14:42:42 (10/01/2011) 

Tea (2.5g) was added to reaction vessel over 5.0 at 14:46:48 (10/01/2011) 

comment: "water appears to be turning a deep brown colour over time - still a clear liquid though." at 14:47:07 (10/01/2011) 
sensor Event: started logging at 14:48:31 (10/01/2011) 
Sensor Event: Stopped logging at 14:50:26 (10/01/2011) 
sensor Event: Below lower bound at 14:51:39 (10/01/2011) 
sensor Event: Below lower bound at 14:51:39 (10/01/2011) 



Figure 6 Example event log file for the creation of a cup of tea, inspired by the Southampton Smart Tea project [30]. New events are 
appended as they occur. 

I J 



functionality is provided through "Video For Windows" 
(V4W) which is not supported on Windows 7. Eventually 
we settled on VLC [12], which is based on Microsoft's 
DirectShow framework (better supported and up to date). 

Because VLC is an application, the problem arose as 
to how to start and stop it from the Ami application. 
Fortunately VLC can be controlled via a telnet connec- 
tion, so Ami uses telnet to configure the video capture 
and to start and stop video capture. There is an addi- 
tional bonus that this separation of video recorder from 
controller enables multiple cameras to be used and also 
to start and stop recording on remote systems, without 
a physical connection to them. 

Linking the videos together also turned out to be 
more difficult than expected. Modern compressed video 



formats such as AVI, MPEG4 work by encoding differ- 
ences between successive frames. When concatenating 
video it is therefore necessary to decompress the videos 
before combining them together and re-encoding them 
using a given compression algorithm, such as an 
MPEG4 based codec. 

Fortunately, VLC again has the ability to do this task 
but due to the nature of video concatenation, this pro- 
cess of stitching together the files is best done at the 
end of an experiment, rather than repeating the CPU- 
intensive process for each stage. Compression artefacts 
are extremely liable to arise from the process of repeat- 
edly decompressing and recompressing as well, degrad- 
ing the quality of the video. It may be possible to pause' 
a recording using the VLC capture, but if any errors 



File Edit View Timeline Navigate Help 

H chemical 10 Jan 2011 



e(CAAMI\e 



B Comment 
M Equipment I 
0 Physical ■ 
H Sensor ■ 
H User 



pm418 created expe 



Large Ceramic Mug 



Sensor control started logging] 

Comment: Water appears to be turning... 1 Sensor control stopped logging 



Sucrose (12. 



Water (350.0cm3) 



Chemical | 

Comment 

Equipment 

Physical 

Sensor 

User 



Figure 7 Graphical view of experiment timeline. The Timeline application [31] is written in Python and receives an XML event-log file created 
by Ami. Timeline takes this event log and displays different sorts of events in different colours. 
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Figure 8 The Ami Experiment Monitoring Tool, here 
monitoring tea temperature... 



arose or power is lost, the video data would have to be 
recovered manually. 

Storing video files alongside the experimental data 
enables the logs to travel with the data, given a reposi- 
tory such as the ELN that can accept arbitrary files as 
part of a submission. 

Wide-angle video monitor 

A common source of error in doing experiments is sim- 
ply absent-mindedness, forgetting to do something, or 
using the wrong chemical. The wide-angle video moni- 
tor is triggered by activity at the fume cupboard, and 
records video until activity stops. This gives the ability 




Figure 9 The infrared sensor being tested on an Arduino 
circuit board. 



to replay events over the course of the experiment, 
hopefully enabling a full picture of what actually was 
done to be understood. Mounting the webcam high up 
at the back or side of the fume cupboard gives the best 
view of activities. 

Two methods of triggering the recording were identi- 
fied. The first was to use an infrared movement detec- 
tor, which was connected to the Arduino. When 
movement was detected, the event is passed by the 
Arduino back to the Ami program, which then starts 
the video monitor. The video simply records for a speci- 
fied duration after movement is no longer detected. The 
second method was by monitoring the changes in the 
image itself, and if a threshold value is reached, to start 
videoing. Unfortunately time did not permit us to 
explore this area sufficiently to get a working system 
going. 

Experiments with the Microsoft Kinect 

Towards the end of the Ami project, Microsoft released 
the Kinect (Figure 10). The Kinect is an accessory to 
Microsoft's Xbox consumer gaming machine, and is an 
exciting new development in human-computer interac- 
tions because it uses purely visual techniques to build a 
three-dimensional understanding of the space in front of 
it. The Kinect can recognise when a person is standing 
in front of it, and automatically determine the positions 
of the person's head, body, arms, hands, legs and feet. 
The user does not need such things as a transmitting 
device or special reflective tags; they just have to stand 
in front of the Kinect. The Kinect is potentially a dis- 
ruptive technology and is already showing huge poten- 
tial in robotics [13]. It has enormous potential for Ami; 
positioning a Kinect in a fume cupboard could give the 
user new ways to interact with the computer, and help 
in monitoring the environment. 

The Kinect consists of a relatively small box (about 25 
x 12 x 3 cm) which has two video cameras built into it 
[14,15]. One video camera is used for normal videoing 
using visible-light. The other is an infrared camera 
which monitors a pattern of infrared dots that the 




Figure 10 The Microsoft Kinect. This connects to a computer via 
a USB connector, making it a powerful way to communicate with 
computers. The infrared transmitter is on the left. 
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device shines into the room [16,17]. The on-board pro- 
cessing built into the Kinect enables it to understand 
the 3D location of all the objects in front of it (i.e. the 
spatial analysis is done by the Kinect itself, rather than 
by the computer that it is attached to). The attached 
computer receives from the Kinect a video feed plus a 
stream of data points of the 3D locations of all the 
objects detected by the Kinect. The Kinect also contains 
four microphones, but using these was not investigated 
in this project because at the time that this work was 
done no code had been released which made the sound 
output available. 

One slight limitation of the Kinect is that its 3D view 
of the area in front of it is necessarily only seen from 
one position [18]. This means that it cannot understand 
a full three dimensional view of an object, because it 
can only see the side nearest the detector. Anything 
behind an object, and the back of an object, cannot be 
seen. This could be improved by using more than one 
Kinect operating together so that they can pool their 
individual views, and no doubt the techniques and code 
necessary to achieve this fuller 3D view will emerge over 
time [19]. 

Monitoring 3D space 

The Kinect returns a three dimensional description of 
what it can see in front of it as well as a conventional 
'RGB' view. The resolution of the normal colour image 
camera is 640 x 480, whereas the three dimensional 
camera is 320 x 240 [20]. Whilst this makes it a poor 
choice for image recognition, logging and so on, the 
depth camera delivers data that is fundamentally una- 
vailable from other sources. This makes it incredibly 
exciting in terms of the types of data and interaction it 
can enable. 

The working range of the Kinect is suitable for a large 
living room, as it was designed with that in mind. It was 
found that in the cramped confines of a fume cupboard 
the detector was not far enough away for reliable opera- 
tion. This rather precludes the Kinect from being used 
for monitoring the 3D environment within the fume 
cupboard (the size of a typical fume cupboard is about 
1.7 m wide x 1.2 m high x 0.7 m deep). So we turned 
our investigations to using the Kinect for controlling the 
computer itself; because the Kinect monitors body 
movements, it might be good for someone who is wear- 
ing protective clothing. 
Using the Kinect to control a mouse 

One of the intuitive ideas for using a Kinect is to detect 
human movement and gestures to control a computer, 
so called 'natural interaction'. One of the first experi- 
ments we tried involved detecting a hand and coupling 
a mouse pointer to respond to its movements. This was 
done at first by crudely detecting the closest 'blobs' pre- 
sent in the depth, i.e. the hands, and using the motions 



of these to control the mouse pointer of a computer. At 
a later stage, we used a much more sophisticated techni- 
que to capture the hand motions, which involved 'skele- 
ton mapping' that understood and interpreted the depth 
of field and looking for humans (Figure 11). (Skeleton- 
mapping, as provided by PrimeSense [21], required a 
stack of software to enable, including the http://www. 
OpenNI.org framework and the SensorKinect driver [22] 
https://github.com/avin2/SensorKinect as well as their 
free closed-source middleware library.) This proved to 
be much more accurate and not affected unduly by 
background movement. 

However, this mouse-metaphor interface proved to be 
a poor one in the end. This was not due to technical 
reasons; simply, the human body is not suited to stand- 
ing still with an arm held out for periods of time. With 
a hand resting on a desk, it is easy to have the accuracy 
needed to click on items. With the arm stretched out, it 
becomes difficult to hold it in a given position for any 
amount of time. 

It is necessary to build the interface so that the inter- 
actions involve periods of relaxation or the ability to 
ignore actions made unintentionally. One particularly 
successful form of interaction is selecting items from a 
menu, where the hand is raised to select an item from a 
list and a choice is made by swiping the hand across. 
Swiping the other hand back across is used to cancel 
that choice. This has the benefit that in between choos- 
ing, the arms can be left to relax without worrying that 
a mouse-pointer would skitter across the screen and 
select or highlight something unintentionally. 
Using the Kinect to control molecule visualisation 
Moving away from the fume cupboard for a moment, 
one potential use-case for the Kinect is to use it as an 




Figure 11 Screenshot showing 3D visualisation of the Kinect's 

interpretation of the volume it can see. Only the user's shoulder 

and hand joints are shown for clarity. 
I ) 
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appliance in a given meeting room or open space for 
collaboration or interaction. We implemented this by 
using the Kinect's skeletal mapping functions to track 
hand positions which were then broadcast via multicast 
to any computer within the same network. This has the 
advantage that the client computers need no knowledge 
of how to read and process Kinect data directly, only 
software that can make use of the hand-position map- 
pings in the same way it might read the location of a 
mouse pointer [23]. At the end of the project, a sympo- 
sium was held in honour of Dr Murray-Rust's ideas 
[24]. Immediately preceding the symposium was a 
hackfest at which our experiences working with the 
Kinect were used to control the rotation and zooming 
of a molecule in Jmol (Figure 12). 

Speech recognition 

For a chemist working in the lab, the ability to use 
speech to communicate with their computer would be a 
great advantage. Preparative work before the start of 
Ami showed that Windows Speech Recognition (WSR - 
the speech recognition facilities build into Windows 7) 
could be used to control [25] the Chemistry add-in for 
Microsoft Word, Chem4Word [26]. Dragon Naturally 
Speaking (DNS) is the leading speech recognition pack- 
age, so this was also evaluated. 

Both WSR and DNS have the ability to define macros 
for navigating around the screen, clicking on buttons, 
etc. The ability of these tools to use speech to control 
an application was tested by trying to use only speech 
to operate the Chemistry Department's ELN, a Java- 
based application developed by IDBS [27]. However, 
neither WSR or DNS worked very well with Java appli- 
cations; WSR in particular is much more functional 




Figure 12 Controlling rotation of a molecule using hand 

gestures. The Kinect is on the bench, on top of the silver cylinder. 
Picture taken at PMR Symposium. 

v / 



with Windows-based applications because it has closer 
ties into the operating system's understanding of what 
objects are being displayed. Controlling the ELN was 
best achieved using send-key type instructions; if key- 
board shortcuts did not exist for a particular activity, 
then this limited the possible actions. 

Both WSR and DNS can be used to dictate text into 
Java applications. The demands of a specialist chemistry 
vocabulary are pretty stringent, however, so for chemis- 
try dictation the transcription accuracy varies signifi- 
cantly. It is possible to train each package to improve 
voice recognition, but this is a potentially enormous 
topic and it was not done to any significant extent in 
this project. DNS has the ability to digest sample docu- 
ments that the user gives in order to understand their 
particular vocabularies, but this was not explored 
beyond initial configuration. 

For the Ami application WSR was chosen for doing 
further development, mainly because of licensing costs; 
DNS is very expensive. WSR has a free extension, Win- 
dows Speech Macros, which enables tailoring of the 
commands used when speech is recognised. This was 
fairly successful and it is possible to navigate all of the 
screens and buttons in the Ami application. WSR listens 
for key phrases, and then uses send-key instructions 
(most commonly an Alt- < single-key > code) to send 
key codes to buttons in the Ami application. Addition- 
ally, WSR can be used for dictating comments (experi- 
ment observations) directly into Ami, though we did not 
have the time to investigate its accuracy or ways of 
enhancing it and it was only used by the development 
team. 

Outcomes & Conclusions 

The main outcome from the project was a demonstrator 
application that shows how experiments and the envir- 
onment around them can be monitored using various 
sensors and video monitors. We had the stretch goal of 
actually having this used by real chemists for real 
experiments, but unfortunately time prevented us from 
polishing the system to a sufficient level to allow this. 

At the launch meeting for the Dial-A-Molecule 
EPSRC Grand Challenge [28], a common theme that 
emerged was the need to have access to chemical data. 
Much of the data generated in laboratories does not get 
collected and made available in a form that other che- 
mists can use. Time pressures mean that very often 
scientists do not get around to making their data avail- 
able. The Ami project showed how there is huge poten- 
tial for computers to help the bench chemist in their 
activities in the lab, and to make much of this informa- 
tion available for further use. In its six months Ami has 
investigated many technologies and ideas; an obvious 
follow-on to the project is to consolidate these ideas 
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into a fully integrated tool that can be used in real 
laboratories. Additionally, there is much potential for 
further work on the flow of data from the experiment to 
electronic lab notebooks to an embargo management 
tool and thence to open repositories, thus facilitating re- 
use. Reviewers have pointed out how important this 
type of data will be for retrospective analysis, especially 
in cases of unexpected results or experimental 
reproducibility. 

Appendix 1: Links to documentation, code 
resources, etc 

Brainstorming session: 

♦ Output from the brainstorming session: https://bit> 
bucket.org/jat45/ami/downloads/Notes%20output% 
20from%20Ami%20brainstorming%20session% 
207Mayl0.docx 

Project website & tags: 

♦ Project blog: http://amiproject.wordpress.com 

♦ Project Wild: http://bitbucket.org/bjb45/ami- 
project 

♦ Project code: http://bitbucket.org/jat45/ami/ 
Software used: 

♦ Java development - IntelliJIDEA Community Edi- 
tion: http://www.jetbrains.com/idea/download/ 

♦ Speech Macros - Windows: http://code.msdn. 
microsoft.com/wsrmacros 

♦ JFreeChart Java graph package: http://www.jfree. 
org/jfreechart/ 

♦ Timeline application: http://thetimelineproj. source- 
forge.net/ 

♦ Natty - Java library for processing data/times: 
http://natty.joestelmach.com/ 

♦ Video capture - VLC: http://www.videolan.org/vlc/ 
Project code: 

♦ Data logger - Arduino program: https://bitbucket. 
org/jat45/ami/src/096e6df85d58/ 
arduinoControllerWithoutSD/ 

♦ Ami application: https://bitbucket.org/jat45/ami 

♦ Experiments with the Kinect: https://github.com/ 
benosteen/Kinect-tracking-code 

Other tools used: 

♦ Speech recognition - Dragon Naturally Speaking: 
http://nuance.co.uk/ 



♦ RFID reader - Touch-A-Tag: http://www.toucha- 
tag.com/ 
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